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Abstract 

We study a constrained stochastic control problem with jumps; the jump times of the controlled process 
are given by a Poisson process. The cost functional comprises quadratic components for an absolutely 
continuous control and the controlled process and an absolute value component for the control of the jump 
size of the controlled process. We characterize the value function by a quasi-polynomial of degree two, i.e., 
a "polynomiaf whose coefficients depend on the state of the system. This ansatz allows us to derive the 
solution of the optimization problem via dynamic programming and a novel interpolation method in closed 
form; the value function is a classical solution of the HJB equation corresponding to the problem. The state 
space is separated by a time dependent boundary into a continuation region where the optimal jump size of 
the controlled process is positive and a stopping region where it is zero. 



1 Introduction 

For most non-linear-quadratic control problems, closed form solutions are rather difficult to obtain as the form 
of the value function cannot be guessed easily. In this paper, we propose an interpolation method for a non- 
linear-quadratic stochastic control problem whose cost functional comprises both quadratic components and 
an absolute value component; we derive the solution of the problem in closed form and show that the value 
function is a classical solution of the correspondiirg Hamilton Jacobi Bellman (HJB) equation. 

Given a coirtrol u = (^, 77), the controlled process X" satisfies the stochastic differential equation 

dX'^(s) = -C(s)ds - ?7(s)d7r(s), = X 

and the terminal constraint lims_j.T- X'^{s) — 0; here, a; G R is the initial state of the system at time i G [0,r] 
and TT is a Poissoir process with intensity 6* > 0. The costs of u are given by 

cT 



J(i,a;,u):=E ^ ki{sf ^ BV\r){s)\ + aa"^ X"" {^'^ ds'^ 



and have to be minimized. 

Using dynamic programming, it can be shown that the valu e function of the corresponding discrete time 
minimization problem is piecewise a quadratic polynomial (see Kratz and Schoneborn |2012a |): At the last 



coirtrol time t^r = T, the value function is quadratic; in order to obtain the optimal control and the value 
function at time i^v-ij the term \r\\ necessitates the distinction of several (more precisely two) cases; the number 
of cases increases with the number of backward time steps. It is hence natural to characterize the value function 
of the continuous time analogue by a quasi-polynomial: a "polynomial" whose coefficients depend on the state 
of the system. Plugging this ansatz into the HJB equation allows us to drive a candidate for the value function 
and the optimal control via extensive heuristic considerations. It turns out that the value function is a true 
polynomial for small states |a;| < (3{t) and for large states \x\ > ^{t) (for functions < /? < 7). For intermediate 
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states (/3(i) < |x| < 7(i)) the value function is given by an "interpolation" of these polynomials; we derive an 
implicit representation of the interpolation function as the inverse of an explicitly known injective function. The 
interpolation method we use appearspromising for the solution of related control problems with both quadratic 
and absolute value cost componentso In the present case, the fact that the candidate of the value function and 
the optimal control is given in closed form is essential for the verification theorem as it enables us to resolve 
problems arising due to the singularity of the value function at time T which stems from the terminal constraint. 

The optimal control of the jump size of the controlled process, rj* , divides the state space into two regions: 
a "continuation region" {\x\ > where [77* | > and a "stopping region" < where 77* = 0. The 

structure of the op timal control hence resembles the solution of free boundary problems arising in optimal 
stopping (see, e.g ., 'Pham' (2009l |) and in singular control problems connected to optimal stopping (see, e.g.. 



Benth and Reikvam [2004] )■ The control problem studied in this paper is obviously not a singular control 



problem. Nevertheless, the similarity of the structure is not surprising due to the "linearity" of the costs for the 
jump size control 77. Similarly, we prove a "smooth-fit" principle for the value function on the boundary /?; it is 
essential in the heuristic derivation of the solution of the optimization problem. 

The paper contribut e s to t he li terature on sto chastic control with jumps; standard references are the book 
by l0ksendal and Sulem l2007t and [Hanson' f2007|. Several papers study stochastic control problems with sim- 



ilar terminal constraints. ISchied et al.. [201 0] study multi-dimensional CARA utility maximization without 

1' umps. The multi-dimensional generalization of the present problem was solved by iKratz and Schoneborn 
2012b| for r = 0; in this case, the optimization problem is linear-quadratic an d the difficulty stems from the 
com bination of the terminal c onstraint and the multi-dimensionality. Finally. Nauiokat and Westrav [2011 | 
and iNauiokat and Horst solve similar control problems by using the stochastic maximum principle and 

obtain presentations of the optimal controls via FBSDEs. I am not aware of any other work where the value func- 
tion is represented by a quasi-polynomial and thus a closed form solution for a non-linear-quadratic stochastic 
control problem is obtained. 

The remainder of the article is structured as follows. In Section [51 we describe the optimization problem 
rigorously. In Section [31 we derive candidates for the value function and the optimal control in closed form 
by extensive heuristic considerations. We analyze the candidate value function in Section [H it is continuously 
differentiable and a classical solution of the HJB equation with singular terminal condition corresponding to the 
optimization problem. In Section[Sl we execute a verification argument. We conclude in Section[B]by discussing 
properties of the optimal control; furthermore, we motivate the optimization problem by an application to the 
finance. 



2 Optimization problem 

In the following, we specify the optimization problem. For a fixed time interval [0, T], we consider the stochastic 
basis (ri, J-',P,F = (J^t)tg[o,T])j where (J-t)t is the completion of {(j{t:{s)\Q < s < t))^ for a 

Poisson process tt ~ (j^i1'))te[o.T] with intensity 6 > 0. 

Let t G [0, r) be a given point in time and x G H. We call a two-dimensional stochastic process 

("(s))se[t.T) = i^is),vis))sG[t,T} 

a control if ^ is progressively measurable and rj is predictable. Given a control u, the controlled process at time 
s £ [t,T) is given by the solution of the following controlled stochastic differential equation: 

(iX"(s) = ~^is)ds ~ 'q{s)dn{s), X"(t) = x (1) 

such that the left hand side in (jlj is well-defined. In view of Equation ([T]) (and somewhat unconventionally), 
we denote ^ as the absolutely continuous control and 77 the jump control (note that the jump size and not the 
jump time is controlled). We impose the following conditions. 

Definition 2.1. Let t £ [0,T) and x G R be fixed. Let u = (u(s))sg[t 7-) {£,{s),ri{s))s£[o^T) be a control, i.e., 
^ is progressively measurable and 77 is predictable. 

We call u an admissible control (and write u £ A{t,x)) if it fulfills the following conditions. 

■^The application of the method to related control problems requires significant adjustments in order to account for problem 
specific properties, cf. Section |3] 
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(i) The Stochastic Differential Equation ([T]) possesses a unique solution on [t,T). 
(ii) 



E 



< oo, 



E 



\v{s)\^ds 



< oo. 



(iii) If 6* = 0, then ?/(s) = for aU s G [t, T). 

(iv) lim X"(s) = a.s. 



Let us shortly comment on Definition [3TTJ Condition (ii) is required for the moment bound in Proposition l2.2l 
which is in turn needed for the verification argument later. Condition (iii) is needed in order to ensure uniqueness 
of optimal controls (cf. the dynamics of the controlled process in Equation ([T]) and the Cost Functional ©). 
The terminal constraint (iv) is motivated the application of the control problem outlined in Section 16.31 the 
terminal constraint can be replaced by any other real number without changing the control problem essentially. 
We readily observe that Definition 12. II is satisfied if ^(s) = and ri{s) = for all s G [t, T); hence A(t, x) ^ 0. 

Definition 12 . 1 1 implies the following moment estimate for the controlled process. We need this result later for 
the proof of the verification theore m in Section [S] (the assertion can be proved by applying standard arguments, 
see lKratz and Schoneboriil |2012b| . Proposition 2.5). 

Proposition 2.2. Let t e [0, T), x e R and u G A(i, x). Then 



E 



sup |X"(s)| < oo, in particular 

t<s<T 



|X"(s)|4ds 



< oo. 



We assume the following costs for an admissible strategy u. 

f-T 



J{t, X, u) 



E 



f{i{s),^{s),X^{s))ds 



(2) 



where / : K," x K," ^ R, /(^, r?, x) := A^^ _^ 0Y\r]\ + aa'^x^ for A > and T, aa > 0. The goal of this paper is 
to solve the following cost minimization problem: 



v(t,x) := inf J{t,x,u). 

ueA{t,x) 



(OPT) 



We observe that ^(s) = r]{s) = results in finite costs; hence v(t, x) < oo and the optimization problem is 
well-defined. 

The key step towards the solution of the Optimization Problem (|OPT|) is the derivation of a candidate 
w : [0, T) X R — > R+ for the value function. Heuristic considerations suggest that w should satisfy the 
following HJB equation: 



dw 
'dt 



{t,x) 



sup 



dw . 



l{w{t,x) - w{t,x- 77)) + -g^it,x)^- f{^,r],x) 



lim w(t,x) 



if a; = 
00 else. 



(HJB) 



The singularity of the HJB Equation (jHJBp is due to the terminal constraint Definition 12.11 (iv) ; it causes 
difficulties for the verification argument as we have to consider the limit s — > T— . In order to resolve this 
problem, it is desirable to find a solution of (|HJBp in closed fo rm. For the case P = , the rnu lti-dimensional 
analogue of the Optimization Problem (|OPTp was solved by iKratz and Schoneborn |2012b| by plugging a 
quadratic ansatz into (jHJBp . In this case, a classical solution of the respective HJB equation is given by a 
quadratic form which is characterized by the principal solution of a matrix differential equation; although an 
explicit solution for this differential equation is only known for the one-dimensional case, explicit upper and 
lower bounds for the solution resolve the problems associated with the singular terminal condition. In the case 
of this paper, a quadratic ansatz fails; the term OT\r]\ renders the optimization problem non-linear-quadratic. 
In order to find a candidate for the solution of the HJB Equation (jHJBp . more elaborate considerations are 
required; this is accomplished heuristically in Section |3] and verified in Section |31 
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3 Heuristic derivation of the candidate value function 



Let us for now assume that a; > and acr^ > 0. The results are symmetric and can directly be transferred to 
the case x < 0; the case aa^ = has a somewhat simpler st ructure and can be obtained b y straightforward 
modifications or by taking the limit aa"^ — >■ (cf. Section [^21). Kratz and Schoneborn |2012a | solve the discrete 



time analogue of the Optimization Problem (jOPT|) in closed form. If F > 0, the value function is not quadratic 
in X because of the term |?7|; instead it is piecewise a polynomial of degree two. The authors prove this result by 
a backward induction using dynamic programming. At the last control time In-, the value function is quadratic. 
In order to obtain the optimal control and the value function at time In-i, the term |?7| necessitates the 
distinction of several (more precisely two) cases; the number of cases increases with the number of backward 
time steps: one additional case per step. The number of polynomials which are glued together in order to obtain 
the value function hence depends on the number of trading times until t^. In a similar way, the optimal control 
is piecewise affine linear in x. Intuitively, a similar structure should hold for a larger class of optimization 
problems with quadratic and absolute value cost components. 

The structure of the value function and the optimal control in the discrete time case gives us certain hints 
about the structure of the solution of the continuous time Optimization Problem (|OPT[) . The continuous time 
model can be regarded as the limit of the discrete time model as the number of trading times tends to infinity. 
In this sense, the finitely many quadratic polynomials forming the value function in the discrete time case 
become infinitely many for the continuous time case; these must be merged together in some way. We establish 
an interpolation method accomplishing this task: a candidate of the value function is identified in closed form 
and we call its representation as a "polynomial" with state-dependent coefficients a quasi-polynomial in the 
following. In view of the soiution of the discrete time optimization problem, this is the natural representation 
for the value function. 

As a first step, we require the results from lKratz and Schoneborn |2012bl | for the case F In this case. 



the value function v and the optimal control u* = (^*,?7*) are given by 

v{t,x;9) = C{t;e)x\ C{t,x;d) = ^^^^^^x, 7j*{t,x;9) = t[e>o}X, (3) 

where 

C{t;9) = ^coth{^{T-t))-^ for 6 := sj9^ + ^. (4) 

We make the following heuristic observations about the structure of the value function and the optimal 
control which are partly inspired by the discrete time case. 

• For small initial states x, the absolute value costs 9r\ri\ outweigh the quadratic costs A^^. Hence, rj should 
be zero and the value function should satisfy v{t,x) = C{t;0)x'^ (cf. Equation (U)). Also the optimal 
control should be given as in ^ for 6* = 0. 

• For large initial states x, the value function is a quadratic polynomial in the discrete time case (as there 
are only finitely many polynomials forming the value function). As the number of time steps approaches 
infinity, this property could in principle break down. The insights from the discrete time optimization 
problem suggest however that this is not the case; we hence make the educated guess that the value 
function is a quadratic polynomial and that the optimal control is afhne linear in x. 

• For intermediate states, we "interpolate" the value function in such a way that it is continuously difFeren- 
tiable. 

In Section r3.1l we make the ansatz that the value function is a quasi-polynomial of degree two. In Section r3.21 
we deduce a candidate for the optimal control (dependent on the coefficients of this quasi-polynomial) using the 
HJB Equation (jHJBp and obtain a candidate for the boundary below which 77 = is optimal. In Section [?751 
we derive differential equations for the coefficients of the candidate value function. 

3.1 Quasi-polynomial ansatz for the candidate value function 

We make the ansatz that a candidate w for the value function is a quasi-polynomial of degree two: 

w{t,x) = Ci{t,x)x'^ +C2{t,x)\x\ +C3{t,x) (5) 



^The important special case 6 = was first solved bv lAlmgren and Clirisl I2OOIII and later bv lSchied eraTI I2OIOII . 
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for functions Ci : [0,T) x R ^ R, i = 1, 2, 3 (cf. the discussion above). 

In the fohowing we reflect on the optimal control. These considerations yield possible properties of the 
coefficients of w as in Equation ([5]). Assume that u*{t,x) = x), ry* (i, x)) is the optimal control. For small 

states, the absolute value costs Or\ri\ are larger than the quadratic costs A^^. Therefore, there should be a time 
dependent boundary /3 : [0,r) R+ such that 

r]*{t,x)=0 for |x| < (6) 

For larger states, the absolute value costs are smaller than the quadratic costs; therefore we expect that the 
control rj is such that a jump of tt decreases the controlled process X" to the level /3, where further controls 
T] > are too costly: 

V*it,x)=sgnix){\x\-m) ior\x\>m- (7) 

As 77* = for |a;| < /3{t), the optimal absolutely continuous control below the boundary should be the one given 
in Equation ([3]) for 9 = 0, i.e, the value function and the optimal control are 

w{t,x)^C{t;0)x^ C{t,x) = ^^^x, 77*(t,x)=0, (8) 

respectively. In other words, we expect the coefhcients of w as in Equation ^ to fulfill Ci{t,x) ~ C{t;0), 
C2{t,x) = 6*3(^,2;) = for \x\ < We illustrate these heuristics in the left and the middle picture of 

Figure [TJ 

Let us now assume that these considerations are true. We hope that the value function is differentiable 
on [0, T) X R. We use this property for the proof of the verification theorem via the HJB Equation (|HJB)) 
(cf. Theorem 15.41 below*). A necessary condition for continuity oi w at x = /3{t) is Ci{t,f5{t)) = C{t;0), 
C2{t,(i{t)) = C3{t,/3{t)) = 0. In order to be differentiable at x = /3(<), the right-hand and the left-hand partial 
derivative with respect to x must be equal, i.e., for t G [0, T), x = /3(t), 

BC' BC' BC^ 

2C{t-0)x = 2Ci(t,x)x + C2{t,x) + x^—^{t,x) + x—^{t,x) + ^{t,x), 

ox ox Ox 

and therefore a necessary condition for differentiability is 

Bf^ BC' BC 

We make the educated guess that this condition also holds for x ^ /3{t) (note that it certainly holds for small 
X < (3{t) and large x as in these cases the coefficients are constant in x): 

o BC-\ . , , , BCo / X BC^ , . „ 



for sdlte [0,T), X eR and thus 



^(i,a;) = 2Ci{t,x)x + sgn{x)C2{t,x). (10) 



3.2 The candidate optimal absolutely continuous control 

We assume from now on that the value function is given by w as in Equation ([5]) respectively as in Equation ([5]) , 
that all partial derivatives exist, that ^ is given as in Equation ([TU)) and that the optimal control rj* is given 
by Equations ^ and ([7]). 

We consider the HJB Equation (|HJBp and maximize the function 

hit, X, ^, rf) := e(w(t, x) - w(t, x - 77)) + -^{t, x)^ - A^^ - OTM - aa'^x^ 
^ ' ox 

^(i,x) X2 ||(i,x)2 



4A 
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state 



State 



State 






Figure 1: Illustrations of the heuristics about the optimal control. In all pictures, the (lower) dashed line denotes 
the time dependent boundary j3{t) below which t]* = 0. Solid lines denote realized trajectories of the controlled 
process. The left picture shows the scenario where the initial state is below /3. The middle picture shows a state 
which is initially above /3. In the displayed scenario, the Poisson process jumps at time r. The third picture 
shows the optimal control for two states when the Poisson process never jumps. For the smaller initial state, the 
controlled process crosses the boundary /3 at time s, i.e., for t < s the smaller solid line represents the function 
X{t, s). The larger trajectory does not cross (3 during the entire horizon; it is above the function X{t, T) which 
is displayed by the second dashed line. 



in (Cv)- Using Equation (jlO[) . we obtain that h is maximal for 

2Ci{t,x)x + sgn{x)C2it,x) 



2A 



(11) 



and for 77* = r]*(t,x) such that := w{t,x — r/) + r|ry| is minimal. For x > I3{t), Equation ([7|) suggests that 
this should be the case for 

r]* =ri*{t,x)^x- Pit). (12) 

Furthermore for jf > 0, h'i-q*) = -^{t,x- if) + F = if and only if ^{t,x - if) = F. Combining these 
observations, we obtain the following candidate for the boundary /3(t): 



2C(t;0)' 



(13) 



3.3 Differential equations for the coefficients 

For now, we consider the case x > I3{t). Given the assumption that w as in Equation ^ solves the HJB 
Equation (|IIJBp with maximizer u* = {^*,ri*) for ^* and ?/* as in Equations (jlip and (|12p . respectively, we 
obtain 

^{t,x)^h{t,x,C,V*)- 
Provided that Equations ([9|) and ([T3)) hold, this implies 



dCi 



dC- 



{t,x)x H — - — {t,x)x-\ — - — {t,x) 



at ' ' _ dt 

V A 



dt 

+ 0C\{t,x)-aa^)x'+(C2{t,x)(^^^ + e) -9T)x + eC3it,x)+ ,^2(^,^)2 



A 



4C(t;0) 



4A 



We hence expect that for |x| > P{t), the coefficients of the candidate value function fulfill the ordinary differential 
equations 



dCl, , Cl(t,x)^ r.^ , . 2 

-Q^{t,x) = ' +0Ci{t,x)^aa', 

9C2,, ^ ^ ^( Ci{t,x) 
— (t,a;) = C2{t,x)[^ — 4 



dC- 



-0F, 

ev^ , C2{t,x)-' 



and that for a: = f3{t), 



^^(,x)=.C3(t,X-) + ^^^^^^^ , 



Ci{t,x) = C{t]{)), C2(t,x)=C^{t,x)=Q. 



(14) 
(15) 
(16) 

(17) 
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In order to transfer the Differential Equations (|T4)) . (fTS)) . ((T6)) and the Conditions (fT7|) into initial value 
problems, we consider the trajectory resulting from the candidate optimal absolutely continuous control Let 
t E [0,r), a; > (3{t) and let s £ [t,T) be the first time such that the controlled process crosses the boundary 
/3(s), provided that the Poisson process does not jump in [t,T). We define 

X{t, s) := x; 

in other words, the deterministic function defined on [t, s] is the candidate for the controlled process 

corresponding to the candidate optimal absolutely continuous control provided the Poisson process never 
jumps. Note also that this implies 

(cf. Equation ([T^ ) . We illustrate the functions X in the third picture of Figure [T] 

We modify the notation for the coefficients of the candidate value function in the following way. If t G [0, T), 
X > (3{t) and if there exists a smallest s £ [t,T) such that the trading trajectory resulting from the candidate 
optimal trading intensity ^* crosses the boundary f3 at time s without any jump of tt, we write 

:=Ci(t,x), C2it,s):^C2it,x), C3it, s) -.^ Csit, x). 

Thus, we expect that the new coefficients Ci, C2 and C3 solve the following initial value problems 

^(•,s) = ^^i^+0Ci(.,s)-aa2, C7i(s,s)=C(s;0), (18) 

^{.,s) = C2{;s){^^^ + e) -er, C2{s,s)^o, (19) 

^(•,.)^^C3(.,.) + ^ + %l^, C3(..)^0 (20) 
and that X solves the initial value problem (cf. Equation ([11])) 

f,,,,._£iM^,,,,_£^._j.,,^,,,„, (21, 

4 The candidate value function 

Following the heuristic considerations of Section [31 we define the candidate value function w by 

w{t, x) := Ci {t, g{t, x))x' + C^it, g{t, x))\x\ + Cait, g{t, x)), (22) 

where Ci, C2 and C3 are the solutions of the Initial Value Problems ([TS)) . ([T^ and ([^U)) . respectively. The 
function 5 : [0,T] x R ^ [0,r] is given explicitly for \x\ S [0, jcIFo)] ^ [X(t,r),oo) by 

[T if |x|e[x(f,r),oo), ^ ' 

and implicitly for |a;| G {^^j^^,X(t,T)) by 

X{t,git,x)) = \x\, (24) 

where X is the solution of the Initial Value Problem ([2T|). i.e., g{t,-) is the inverse function of X{t,-). It is 
not immediately clear that such an inverse function exists and that the function w defined by Equation (|22l) is 
well-defined. 

The remainder of the section is structured as follows. In Section [4. 11 we compute the solutions of the Initial 
Value Problems ([TSj), ([TO)) . (|20p and ([^T|) in closed form. This enables us to prove that w is well-defined. In 
Section 14.21 we prove that w is continuously differentiable and strictly convex in x. Finally, we show that w is 
a classical solution of the HJB Equation (|HJB[) in Section 14.31 

In Sections Bl- I6.1[ we assume that aa^ > 0. We treat the case aa^ = in Section [ 
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4.1 Closed form solutions for the coefficients and the trading trajectory 

In order that the value function is well-defined, the function g must be well-defined. Therefore, we require that 
X is strictly monotone in s (cf. Equation (j24p ). We prove this by directly computing the partial derivative of 
X with respect to s and show that it is strictly positive. 

We start by giving closed form solutions for the value function coefficients Ci, C2, C3 and for X, which 
follow from the Initial Value Problems (|18p , , and (PT|) , respectively. Proposition 14.11 treats the case 
s £ {t,T), the case s = T is treated separately afterwards. 



Proposition 4.1. Let t e [0,T), s G {t,T) and define 

OA 



^(s) := ^Cis;0) + 9A ^ ^^^^ _ arcoth(Ai(s)); (25) 
recall that 6 = ^6^ + Then 

C, it, s) = — coth (-(,s -t) + ^{s)) - ^ > 0, (26) 
C(t,c)- { , Ag(sinh(f(5-t))+M(g)cosh(f(g-t)))-2C(g;0)exp(f(^~s)) x 



Ai(.s) sinh (I (s-t)) -fcosh(f(s-f)) 



at. ,) . - /'exp - «)) ( jjI^ + %22)<i. < 0, (28) 

+ ^ ^0^1^ (o - ^)) (o(* - ^)) - (29) 



Proof. Note first that for s G (i,T), C(s; 0) > Vckj^A by Equation (g]). Therefore, 



= VA26'2 + Aaa'^A < AO + 2Vaa^A < AO + 2C(s; 0); 

thus /i(.s) > 1 and k{s) as in Equation ([?5|) is well-defined for all s G [0,T). 

Equation follows directly as is an initial value problem for a Riccati equation with constant 
coefficients. ([T^ . (PU)) and (PTjl are initial value problems for inhomogeneous linear differential equations 
whose solutions are readily computed (note that -(jpo) continuous). In order to obtain Equations ([??)) . (pS)) 
and (j29p . elementary but tedious algebraic manipulations are required which can be executed by computer 
algebra software Q □ 

As C(T;0) is not defined and lim^^T- C(s; 0) = 00, Ci{t,s), C2{t,s), C3{t,s) and X{t,s) {t G [0,r)) as in 
Equations ([26)) - ((29|) are not defined for s = T . However, we require these objects for the definition of the 
candidate value function w. We define Ci{t, T) := lim^^r- Ci{t, s) and X{t, T) lims^T- X{t, s). Elementary 
considerations verify that these limits exist and are given by 

Ci(i, T) = ^ coth (-(T - t)) - - > 0, (30) 



C,it,T) = -l cxp(0(i-.))(-g- + ^(^)d.<O, (32) 



4C(w;0) ^ 4A~ 

^^'^^^={TA^^y'^^2^^-'^^'''''^2^^ ^''^ 

It follows immediately from the Formulae (j^S]) - (|29p that both the coefficients of the candidate value function 
and the trajectories X are continuously diflterentiable, even analytic. 



* Alternatively, detailed proofs for these equations can be found in iKratd I2OIIII ; this applies also for later equations whose 
derivation require tedious algebraic manipulations. 
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Corollary 4.2. Let t G [0,T), s G {t,T). Then Ci, C2, C3 and X have continuous partial derivatives of any 
order in (t, s). 

Ill order to show that the function g given in Equations ((23)) and (j24|) and thus the candidate value function 
is well-defined, we need monotonicity of the function X{t, •). Given Equation (|^^ . we can directly compute the 
partial derivative of X with respect to the second argument. Algebraic manipulations confirm that X(t, ■) is 
strictly increasing in {t,T) as required (cf Footnote 0]) . We can hence prove the central result of this section. 

Proposition 4.3. The candidate value function w given by Equation (j22p is well-defined. 

Proof. By the discussion above, X{t,-) possesses an inverse on {t,T). Thus, g as in Equations and ([M)) 
is well-defined on [0,r) x E, (cf. also Equation Q). Furthermore, = g(t, \x\) G [t,T] for aU t € [0,T), 

x e R, and the functions d {i = 1, 2, 3) are well-defined for t e [0, T), s e [t, T]. □ 



4.2 Differentiation and convexity of the candidate value function 

The goal of this section is to show that the candidate value function w is continuously differentiable. We are 
also able to compute the partial derivatives ^ and It turns out that ^ has indeed the form we 

assumed in the heuristics in Section [Ql (cf Equation (|T0)) ). We also show that > and hence that w is 
strictly convex in x. We first state the main theorem. 

Theorem 4.4. The candidate value function w given by Equation (j22p is continuously differentiable on [0, T) X 
IR. Furthermore, we have 

dw 

— {t,x)=2Ci{t,g{t,x))x + sgn{x)C2{t,g{t,x)), (34) 

\^{t,g{t,x))x^ + ^{t,g{t,x))\x\ + ^{t,g{t,x)) else. ^ ' 

Before we proceed with the proof of Theorem 14.41 we show that g is continuously differentiable. We prove 
this in the following lemma and compute the partial derivatives of g. 

Lemma 4.5. Let V := {{t,x) e R^\t G (0,T), x G {X{t,t), X{t,T))}. Then g given by Equations ^ and ^ 
is continuously differentiable on V and 

dg,. 1 dg , _ ^{t,g{t,x)) 

a.(*'^)-^(,,,(,,.))' dt^'^^^^-%it,git,x)) ^''^ 

Proof. Consider the open set U := {(t, s) £ R^|t G (0, T), s G {t, T)} and the continuously differentiable function 
h : R^ — > R^, h(t,s) := (<,X(t, s))^, (cf Corollary [321) ■ Then for aU (to,so) G U, the Jacobian matrix of h is 
given by 



Dh{to,so) := 



.0 §7(^0,^0)^ 



Note that ^(io, so) 7^ as X(to, •) is strictly increasing. Therefore detDh{to, sq) = ^(^o, so) 7^ 0, and we can 
apply the inverse function theorem. Thus, the inverse function oih exists locally and is locally continuously 
differentiable. However, on V h{U) = {{t,x) G B?\t G (0,T), x G {X{t,t),X{t,T))}, we have h-^ = g for 
g{t,x) := (t, (?(t, x))^ globally, and therefore g is continuously differentiable on V. 

The first equation in (pS)) follows from Equation immediately; the second equation follows by differen- 
tiating with respect to t on either side of Equation ([M)) . □ 

It follows directly that w is continuous 011 [0, T) x R. We can now prove the main building block of the proof 
of Theorem 14.41 we show that 



—^{t, s)X{t, sf + —^{t, s)X{t, s) + — ^(t, s) = 0. 
OS OS OS 

This is equivalent to Equation © in the heuristics of Section 13.11 and was the key step towards the derivations 
of the differential equations for the coefficients Ci, C2 and C3. Therefore, the construction of the candidate 
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value function relies strongly on this property. Recall that we had good reasons to believe that Equation ^ 
is true for < f3{t) (or equivalently s = t) and for > X{t,T) (or equivalently s = T). It is somewhat 
surprising that it is indeed also correct for t < s < T. 

The second part of the lemma is a similar assertion which is useful for the computation of the second order 
derivative and hence for the proof of the convexity of w below. 

Lemma 4.6. Let t G [0,r), and s G [t,T). Then 

BC - BC - BC 

a{t, s) := ^{t, s)X{t, s)' + ^{t, s)X{t, s) + ^{t, s) = 0, 
OS OS OS 

(ii) 

BC - BC 

b{t, s) := 2^{t, s)X{t, s) + ^{t, s) = 0. 



Proof. (i) We first show that 



a{s,s) = lim a{t,s) ~ (37) 



by computing the derivatives of Ci, C2 and C3 with respect to s. Secondly, we verify that 

— {t,s)=Ba{t,s). 

Hence, there exists a constant C(s) (s G (0,7)) such that for all t G [0, s), a(i, s) = C(s)exp(0<). Equa- 
tion ((57|) implies = limt^s- a(i, s) = C'(s) exp(6's), i.e., C(s) = 0, finishing the proof of (i) (cf. Footnote^] 
again for details). 

(ii) We proceed similarly as in the proof of (i) and show limt^s_ 5(i, s) = and f|(t, s) = 9jb{t, s), 

from which the assertion follows. 

□ 

We are now able to prove that w is continuously differentiable. 

Proof of Theorem \4-4\ Let t G [0, T), x G K,. We only treat the case a; > 0. The case a; < follows accordingly. 
We consider four cases separately. 

(i) X < 2cft-o) • ^^^^ case we have g{v, y) ~ v for all (u, y) in some neighborhood of {t, x) (cf. Equation (j23p ). 
Therefore, w{v,y) = C(w;0)y^ and consequently (recall that Ci{t,t) ~ C{t;0), C2(t,t) = 0) 

-^(i,x) = 2C{t]0)x = 2Ci{t,t)x + C2it,t) = 2Ciit,g{t,x))x + C2it,git,x)) (38) 

and 

^{t,x)^C'{t;0)x\ (39) 

(ii) X G (jc^j^, -?(i, T)). This is equivalent to a; = X{t,s), g{t,x) = s for some s G {t,T). We have 
y G { 2C{vO) ' "^(^' '^)) ^'^"-^ therefore g{v,y) G (t,r) for all {v,y) in some neighborhood of {t,x); thus 

w;(t, 2/) Ci (t, 5(t, 2/))2/2 + C2 (t, 5(i, 2/))?/ + Cait, g{t, y)). 
Using Lemma 14.51 and Lemma 14.61 (i) , we obtain 

Bw 

— {t,x)=2Ci{t,g{t,x))x + C2{t,g{t,x)) (40) 



and 



— (t,a;) = -^{t,g{t,x))x' + -^{t,g{t,x))x ^ ^(t,g(t,x)). (41) 
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(iii) X > X{t, T). In this case we have y > X{v, T) and g{v, y) — T for all {v, y) in some neighborhood of {t, x) 
(cf. Equation ^ again); thus = Ci{v,T)y'^ + C2{v,T)y + C-i{v,T). Therefore, 

dw 

— it, x) = 2Ci{t, T)x + C2(t, T) = 2Ci (i, + C2{U 9{t, x)), (42) 

-(M) = — (t,T)x +_(t,r)x + — (t,r). (43) 

(iv) X G { 2p(f.o) 1 -^(.^7 ^)}- Recall first that w is continuous. Furthermore, as g{t,-) is continuous in x with 
values in [t, T] and Ci and C2 are continuous in [t, T], ^{t, •) can be extended continuously to R (cf. also 
Equations ([55)) . (^0]) and ([H])). Let now /i„ 7^ (71 € IN), — >■ 0. For large enough n, the mean value 
theorem implies that there exists ^„ strictly between x and x — hn such that "'(*'^)~^(*^^~^'") — l^f^i^^^y 
As lim„^oo — 2;, this implies 

9w w{t,x) - w{t,x - hn) u t \ 

— {t,x)= hm = hm -^(t,4n), 

ox n-i-oo hn n-too (Jx 

i.e., z/;(<, •) is differentiable in x with derivative 

— it,x) = lmi^—it,^n) = 2Ciit,git,x))x + C2it,git,x)). 

For differentiation with respect to t, note that by the differential equations for C(t;0), Ci(-,s), C2(-,s) 
and C3(-, s), we obtain for x = 2c^fn) that 

^it,t)x' + ^{t,t)x+^it,t) = C'{t;0)x\ 

Therefore, ^(- ,2;) can be extended continuously to [0,r) by Equations (P^ . (|¥T|l and Using the 

mean value theorem in a similar fashion as before, we obtain that w{-, x) is differentiable in t with derivative 

^(t .i^(t^i)^^ + ^it,t)x + ^{t,t)=C'{t;0)x^ if^=2CTEo) 
\^(t,r)x2 + ff(t,T)x+^(t,r) ifx = X(t,T). 

□ 

By Theorem 14.41 we obtain first order partial derivatives of the candidate value function w. We can deduce 
strict convexity of w in x by computing the second order partial derivative . The key step towards this goal 
is Lemma 14.61 (ii) . 

Theorem 4.7. The candidate value function w given by Equation (j22p is strictly convex in x G R. 

Proof. Let t S [0,T) and x G R. We consider the case a; > 0. The case a; < can be proven accordingly. Thus, 
X = X{t,s) for some s G [t,T) or x > X(t,T). In the first case Theorem 14.41 Lemma [4.51 and Lemma [4.61 fii) 
yield 0(i,x) = 2Ci{t,g{t,x)). For x > X{t,T), we obtain ^{t,x) = 2Ci(<,T). Hence, ^{t,x) can be 
extended continuously to a; = X{t, T) and we obtain 

^(t,X(t,r))==2Ci(t,T) 

by the same argument as in the proof of Theorem 14.41 Therefore (and by the respective considerations for 
a; < 0), the second partial derivative of w with respect to x exists and ^^{t,x) > 0, hence w is strictly convex 
in X. □ 
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4.3 Classical solution of the HJB equation 

The fact that w is differentiable and the formulae for the partial derivatives finally enable us to prove that w is 
a classical solution of the HJB Equation (|HJBp . 

Theorem 4.8. The candidate value function w given by Equation (|22p is a classical solution of the HJB 
Equation (jHJBp with unique maximizer u* = where 

C - Cit ^) ■= sit, x))x + sgn(x-)C2(t, g(t, x)) ^^^^ 



Proof. The theorem follows directly from the subsequent Lemma and Theorem 14.41 bv using the Differential 

Equations p^ . (fTO)) and (|^D|) for the case |a;| > ^^1"^.^^^ and the differential equation C"(-; 0) = ^^^^x^^ «f ^ for 

the case |x| < 2C{t-o) ■ '-' 
Lemma 4.9. Let /i : [0, T) x R x K, x R 11 6e given by 

h{t, X, ^, 7]) ■= 9{w{t, x) ~ w{t, X - 7])) + —{t, x)C - /(^, 77, x). 

For fixed t G [0,T) and x S R, h{t,x, •, •) attains its unique maximum at u* = (^*,?7*) for ^* arid 77* as in 
Equations (j44p and (j45p . respectively. 
Moreover, 



h{t,x,e = { 



+9C^{t,g{t,x)) + + ^MM^ 7f \x\ > ^ 



(46) 



Proof Let t e [0,T) and x e R. We have 

X, ^, r/) = x) — OiG^x^ + x, ^) + /i2(i, x, r\) 

for 

h,{t,x,o := -Ae + ^(t,^)^ = -^mf^ " ^) + ^^li^' ^^(^'^'''^ ^= " " 

As A > 0, hi{t,x,-) is strictly concave in ^. Furthermore, h2{t,x,-) is strictly concave in rj by Theorem 14.71 
Thus, h{t, X, •, •) is strictly concave in r/) and attains its unique global maximum in (^*, rj*) if hi{t, x, •) attains 
its unique global maximum in ^* and /12 attains its unique global maximum in rj* . 
By Theorem 14.41 hi attains its unique global maximum for ^* as in Equation (jH]). 

Note now that /12 < 0. For a; = 0, h2{t,x,T]*) = /i2(i,0, 0) = 0, and therefore /12 attains its unique global 
maximum in 77* as in Equation (|45l) 

^ t:^^ — I ^ I \ 

2C(t;0) ' 



For 77 7^ 0, /i2 is differentiable in 77. For \x\ > 2cJt-o) ' have 



(i,x,77*)-0(£(t,x-7;*)-sgn(a-)r) = ^^(2C(^; 0) sgn(x)^^^ - sgn(x)r) 



for 7]* ~ ri*{t,x) as in Equation (|l5]) (note that 7f{t,x) 7^ for |.t| > 2C(t-o) )• strict concavity, we conclude 

that h2{t,x, •) attains its unique maximum at rj* as in Equation (j45p 

r 

2C(t;0) ' 



Let now a; e (0, „„r „s ). We have 



dh 

lim — ^(t,a;,77)= lim 2eC(t;0)(x - 7j) + OF 2eC(t;0)x + OF > 0, 

v^Q- or] jj->o- 
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lim —^(t,x,ri)= lim 20C(t;O)(x - i]) - OT ^ 20C(t;O)x - 0T < 0. 

Therefore, rj* = maximizes /i2 uniquely by strict concavity as required. 

By continuity of rj* and h2, r]*{t,x) = maximizes /12 uniquely for x — 2C{fO) • 

The case a; € [~ 2C(Fo) ' foUo'^s similarly as above. We plug (C*,*?*) into h and obtain Equation (|46)) . 
finishing the proof. □ 



5 Solution of the optimization problem 

In the previous sections we collected the building blocks for solving the Optimization Problem (jOPTp . The 
goal of this section is to prove that (jOPT[) is indeed solved by the candidate optimal control u* = {^*,ri*) 
and that the value function is given by the candidate value function w. Given the control u*, we denote the 
process controlled by u* by X* := X" . We proceed as follows. In Section 15.11 we obtain bounds for w, u* 
and X* . Using these bounds, we show that u* is an admissible control. We prove the verification theorem in 
Section W% For both tasks it is essential that the w and u* are given in closed form. Firstly, this enables us to 
verify that the required moment bounds for u* hold. Secondly, the bounds for u* turn into an upper bound for 
X* via Gronwall's inequality; this is required in order to prove that the terminal constraint (Definition [3TT] (iv)) 
is fulfilled. Finally, the closed form solutions are key for the verification argument: Because of the conjectured 
singularity of the value function at terminal time T, we have to consider the limit s — > T and exchange integration 
and limits; the main step in this respect is accomplished in Lemma 15.51 



5.1 Admissibility of the candidate optimal control 

Using Equation (|26p . it can be shown by direct compu tation of the respective partial derivative that Ci(t, •) is 
strictly decreasing in [t^T] (for details, see Krat j |2011 | again, cf. Footnote 0]) . By the series expansion of coth. 
Equation ^ and Equation ([50]) we obtain the following inequalities. For t £ [0, T) and si, §2 <E (t, T), si < S2, 

< at; 9) = Ci(t,T) < Ci(i,S2) < Ci(t,si) < Ci(i,i) = C{t;0)<^^^+ Vaa^A. (47) 

Using Taylor's theorem with integral remainder term, we can deduce the following useful bounds for the 
candidate value function w and the candidate optimal absolutely continuous control 

Proposition 5.1. Let t G [0, T) and x 0. Then 

Ci[t,T)x^ < w{t,x) < C{t;0)x^ < (^j;^ + V aa^ x^ , (48) 

'''(''^'■.i<ir(«..)i<S|^)w<(^ + ,/?)i4 (49) 



A ' ' 1^ ^ ' 'I - A ' ' - \T-t y A 
Proof. Note first that w{t,0) = |^(t,0) = by Equations ^ and (jMl) (recall that g(t,0) = t). Thus, 

wit,x)=w{t,0) + —{t,0)x + J^ —(t,y){x~y)dy^2j^ Ci{t, g{t,y)){x - y)dy 

(cf. the proof of Theorem 14. 71 for the second equality). Using (|T7)l . we can directly deduce Furthermore, 
|f(t,x)=2Ar(i,x). Thus, 

2ACit,x) = -£it,0)+ ^{t,y)dy = 2 ^{t, g{t,y))dy, 

and (gni) follows from (gT]). □ 

Using Gronwall's inequality, we can deduce an upper bound X* . 
Corollary 5.2. Let t e [0,T) and x e R. Then 

Ci{u,T)^ ,Ae. sinh(|(r-s)) 



\X*{s)\ < \x\ exp ( - £ ^^^du) = \x\ exp (^(. - t)) 



sinh(f(T-t)) 
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Proof. We define the process {X{s))s£it.T) as the solution of the initial value problem 

By the structure of the process 77* (cf. Equation (05])), we have that for all s G [0,T), |X*(s)| < |A'(s)|. 
Therefore, by Gronwall's inequality. Proposition 15.11 and Equation ([50)1 . 



\X*{s)\ < \X{s)\ < |x|exp 



Ci(u,T) \ ,A0, ^,sinh(|(r-s)) 

\' ' du] = \x\cxp( — {s-t)) ^ ^ 

A / I I 2 ^ ^^inh(|(r-i)) 



as required. 

The bounds derived above allow us to deduce admissibility u* . 



□ 



Proposition 5.3. Let t £ [0,T), x € R be the state at time t and u* = '^^ Equations (j44p and 

gS]). T/ien u* e A(i,x). 

Proof. Note first that (i) of Definition 12. II is straightforward and that (iii) holds as > 0. By Proposition 15. 11 
Corollary 15.21 and Equation ^ we have 



C(s;0) 



\C{s,X*{s))\ < ^^\X*{s)\ < Ixl^ — exp(— (s-t))- 



a" 



sinh(|(T-s)) cosh(yif^(r-s)) 



sinh(f(r-t)) sinh(J^^f^(r-s)) 



1 



< 00 as s — > T - 



Thus, E[/f |e(s,^*(s))|'*ds] < 00. As X*(s-))| < \X*{s-)\, we have E[/f |77*(s, X*(s-))|«ds] < 00 by 



Corollarv l5.2l Finally, again by Corollary 15. 21 hnis^T- X*{s) ~ 0. 



□ 



5.2 Verification 

We are now finally able to prove that the Optimization Problem (jOPTp is solved by the candidate optimal 
control in Equations (02]) and (05]) and that the value function is given as in Equation (P^ . 

Theorem 5.4. The value function of the Optimization Problem (jOPTp is given by 

v{t, x) - Ci{t, g{t, x))x^ + C2{t, g{t, x))\x\ + Csit, g{t, x)) 

for t g [0,T), X € R" (cf. Equation (|22p ) where Ci, C2, C3 and g are given as in Section^ The P (g) A - a.s. 
unique optimal control is given by u* = (^*,?7*) as in Equations (j44p and (|45p . respectively. 

For the proof of the theorem, we require the following lemma, which relies on the fact that the value function 
V is an upper bound for the value function for F = given in Equation 

Lemma 5.5. Let t E [0, T), 2; G R and u G A(t, x ). Then\iuYs-^T-^[w{s,X'^{s))\ =Q. 

Proof. Note first that there exists a constant A' > such that 

K 



T ~t 



x^ < C{t]e)x^ < v{t,x), 



(50) 



where C{t;9) is as in Equation (U). A control u e A{t,x) has finite costs J{t,x,u) < 00 by Definition 12.11 (ii) 
and Proposition 12.21 Let now s G {t,T). Then 



-E 



J(t,x,M) = E 1^ (^Ai{rf +eT\ri{r)\+aa^X''{rf^dr 

(^A^irf +eT\'n{r)\+aa^X''{rfyr + v{s,X''{s)) 

-X"(s)2 



Ai{rf + eT\ri{r)\ + aa^X^'irf^dr 



> E 



J50t 

> E 



A^{ry + er\r]{r)\ + aa'X''{rY]dr 



Kl 



T-s 
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Thus by the monotone convergence theorem, 



J{t,x,u)> lim (E / {Ki{rf +eT\i^{r)\+aa'^X''{rf)dr 



X"(.s)2 



T - s 



J{t, X, u) + K hm 



T -s 



hence lims_j.T_ E[ ] = 0. The assertion now fohows dhectly from Proposition 15. II fcf. Inequahty □ 

Proof of Theorem \5.4\ Let t G [0,r), x G R, w G A{t,x) and s G [t,T). We apply Ito's formula to the function 
w{r, X'^{r)) (recall that w is differentiable by Theorem 14.4^ : 



w(t,x) = w{s,X^{s)) + 



( — {r, X"(r))e(r) - ^(r, X"(r))) dr 



V dx 

+ j (u;(r,X"(r-))-w(r,X"(r-) -?7(r)))7r(dr) 
< + / /(e(r),77(r),X"(r))dr + / (w(r, X"(r-)) - ii;(r, X"(r-) - 7y(r)))7r(dr) 



6'(w(r,X"(r-)) - w(r,X"(r-) - 7?(r)))dr 



(51) 



u;(s,X"(s))+ / /(e(r),?7(r),X"(r))dr + / (w(r, X"(r-)) - w(/, r, X"(r-) - 7?(r)))M(dr), (52) 



where M is the compensated Poisson process given by M{r) := 7r(r) — Or and Inequality ([5T|l follows from 
Theorem 14. 8[ with equality if and only if X[u = u*] = 0. Taking expectations on both sides, we obtain 

w(t,x) <E[w{s,X''{s))]+E /(^(r),77(r),X"(r))dr 

w{r, X"(r-)) - w{r, X"(r-) - 'n{r))M{dr)] , (53) 

with equality if and only if A (g) P[u = u*] = 0. By Proposition 15. 11 there exists a constant K = K{s) such that 



E 



I |w(r,X"(r-))-w(r,X"(r-)-77(r,X"(r-)))|2dr] <K{s)(e^J^ {\X''{r-)\'^ + \i]{r)f)dr\'^ 



< oo 



by Definition 12.11 (ii) and Proposition 12.21 As {M){s) = 9s, this implies that the stochastic integral in Equa- 
tion (j52p is a martingale. Thus, taking the limit s — > T— in Inequality (|53p. we obtain by Lemma 15.51 and the 
monotone convergence theorem that w{t,x) < E[Jj f{^{r),i]{r),X'^{r))dr] = J{t,x,u), again with equality if 
A®P[u = w*]=0. 

For uniqueness, let u — {£,,ri),u = (C: ^) G A{t,x) and /i g (0,1). We define the convex combination 
w = (^,f?): 

C(s) = K(s) + (1 - A')e(s), 77(s) = mis) + (1 - /i)^(s) 
for s e [t,r). Thus, X"(s) = Ai^"(s) + (1 - m)^"(s) and u S A(i,a;). Notice that 



A[it 7^ t2] > implies P®A[^7^|] >0 



(54) 



as else Ppim^-^T- ^^i^) lims^T- X'^{s)] > 0, a contradiction to Definition 12. II (iv). Hence by the convexity 
of/, 



J{t,x,u)^E / f{ar),v{r),X^r))dr 



< E 



'yM, ^"M) + (1 - M)/(e>), ^M, X"(r))dr = fiJ{t, X, u) + {l- pi)J{t, X, u); 



by the strict convexity of / in the first argument and we have equality if and only ifu = uP®X - a.s. □ 
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6 Properties and application 



In this section, we discuss the properties of the value function v and the optimal control u* . In Section 16.11 
we discuss the dependence of u* and v on F; this is enabled by the fact that both are given in closed form. In 
Section W7I[ we analyze the case aa^ = which we had excluded in Sections U] and [S] We conclude by motivating 
the optimization problem by applying it to a financial market model in Section 16.31 

6.1 aa^ > 

Theorem 15.41 confirms the structure of the optimal control and the value function of the Optimization Prob- 
lem (jOPXp we have expected in the heuristics of Section [3] (cf. also Figure [1]). 

Both for large initial states x {\x\ > X{t,T)) and for small initial states (|a;| < X{t,t) — j3{t) — 2C(t-[)) )' " 
a quadratic polynomial. In between, it is an "interpolation" of these polynomials. The value function and the 
optimal control for |a;| < 2C(t-[)) ^'^^ same as the ones for = (in particular, 77* = 0). For larger states, 
the absolute value of 77* is positive; after the jump of the Poisson tt process at time s, the controlled process is 
X*[s) = 2C(s-o) ■ '^-'^^ optimal trajectory until a jump of tt for an initial state \x\ = X{t,s) <E {X{t,t), X{t,T)) 
is given by the function X{-, s) in [i, s]. 

It is interesting to examine the dependence of v and u* on F. Costs are higher for larger F and therefore the 
value function increases in F (cf. the Cost Functional Furthermore, the jump control i] is less attractive 

for large F and therefore rj* should decrease in F whereas the optimal absolutely continuous control ^* should 
increase in F. The following proposition confirms these intuitions. Additionally, (i) of the proposition shows 
that the costs for the jump control, 0F|77*|, are negligible for large initial states |x| >> X{t,T) as in this case 
v{t,x) « Ci{t,T)x'^ which is independent of F. To stress the dependence on F, we add it as an argument for 
the remainder of the section and write u*{t,x,T) := u*{t,x), etc. 

Proposition 6.1. Let t e [0,T), s e [t,T] and a; e R. Then 

(i) Ci(t,s,-) is constant, 6*2(^,5, •) is strictly increasing and C'i{t, s, ■) is strictly decreasing. 

(a) X{t,s,-) is strictly increasing. 

(Hi) \^*(t,x,-)\ is strictly increasing and \ri*{t,x,-)\ is strictly decreasing on the interval (0, 2|a;|C(i; 0)) and 
constant on the interval (2|a;|C(<; 0), 00). 

Proof, (i) , (ii) The assertions follow directly from Proposition 14.11 respectively Equations (|30p - . 

(iii) Note first that \'q*{t,x,r)\ > if and only if F G {0,2\x\C{t]0)) (cf. Equation (gS])). Hence both controls 
are constant for F > 2|.T|C(t; 0). 

For monotonicity of let without loss of generality x > and F < F < 2xC{t;0). By (ii) (cf. Equa- 
tion (IMl)), g{t,y,t) < g{t,y,T) for aU y e [0,a;] with strict inequality for 2C{t-o) < V < ^it:T,T). 
Therefore (cf. the proof of Proposition 15. ip , 

r {t, x,T)^jJ^ Ci{t, g{t, y, F), F)dy < J 9{t, V, r),T)dy = C {t, x, f) 

by (i) and the fact that Ci is strictly decreasing in s (cf. the discussion at the beginning of Section 15. ip . 
Monotonicity of |ry*| follows directly from Equation 

□ 

In Figure [21 we compare the optimal control for F > (left picture) and F = (right picture) for a numerical 
example. In both pictures, thick solid lines denote realized trajectories of X* . For those scenarios where tt jumps 
at time t < T, the dotted lines refer to the continuation of the trajectory without jump. The dashed line in the 
left picture corresponds to the boundary /? and the thin solid line in the right picture corresponds to the case 
9 = 0. For the larger initial state, the boundary /3 is never crossed unless tt jumps (upper solid line respectively 
dotted lines in the left picture). At all times, the optimal jump control is such that after a jump of tt, the 
state is exactly on the boundary. Afterwards, the controlled process X* stays (strictly) below the boundary 
for the entire horizon. In comparison to the optimal control for F = (thick solid line in the right picture), 
the absolutely continuous control is larger (cf. Proposition 16. II (iv)); it is however smaller than the control for 
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Figure 2: Optimal controls for F > (left picture) and F = (right picture). In both pictures, thick solid lines 
denote realized trajectories oi X*. For those scenarios where the Poisson process jumps at time t = 0.4 < T = 1, 
the dotted lines refer to the continuation of the trajectories without jumps. The dashed line in the left picture 
corresponds to the boundary /3 and the thin solid line in the right picture corresponds to optimal control for 
9 = 0. The larger initial state is x = 1.2; the smaller one is x = 0.3 (which results in s = 0.1). Furthermore, 
A = 2.5, a = Aa=l,e = 3T = 2. 



0. The introduction of the jump control decreases ^* (see Kratz and Schoneborn |2012b| ): this effect is 



decreased significantly by the introduction of the absolute value costs for the jump control. Furthermore, the 
optimal jump control is smaller than for F = 0, where ri{t, x) = x is optimal. For the smaller initial state, the 
boundary /S is crossed at time s, i.e., the optimal trajectory X*(t) until s is X(t, s) (unless the Poisson process 
jumps before). After the controlled process crosses the boundary it stays (strictly) below it until the end of the 
horizon. 

6.2 aa^ = 

In Sections 2] and [S] we excluded the case aa^ = 0. The main reason was that in some formulae the term 
aa^ appears in the denominator (cf., e.g.. Equations (P^)) and and it would thus have complicated the 

exposition of the results. However, the case acr^ = can be treated in a similar way as the case aa^ > 0. 

We define Ci, C2, C3 and X as before by the Initial Value Problems (jl8p - (EH- Note that only the differential 
equation for Ci depends on aa^. Therefore C2, C3 and X only depend on aa^ through Ci. We can compute 
solutions of the initial value problems directly or by taking the limits for aa^ in Equations ([25)) - ([2^ . 

Note first that aa^ = implies 9 = 6 and C{t; 0) = Therefore, 

^(^'^)=^(^)=2ck = ^(^-*)- 
We can compute the partial derivative of X with respect to s and obtain ^{t, s) = 0; therefore, 

Xit,s)=X{t,t) = ^iT-t) (55) 



for is [0,r), s € [t,T]. Hence, we expect only two different control regions. We expect that |?7*| > only for 

2a( 



I a; I > Tf:iT — t) and that the value function and the optimal control are given by 



respectively 



v(t T) = I ^ < - ^) f56) 

^ \Ci{t,T)x^ + C2{t,T)\x\+C3{t,T) if > J^(T-i) ^ ' 



1 a,,, ( 2Ci{t,T)x+sgnix)C2(t,T) -r , , ^ (T - 



:= - ^(^-*)) if > ^(^-^) (58) 

lo ifN<^(T-t), 

All steps of the proof of Theorem 15 .41 can be replicated for the case aa^ = in a straightforward manner. The 
solution of the Optimization Problem (jOPTp is given by Equations (|57p and ([55)1 : the value function is given 
as in Equation (|56p. 
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Figure 3: The left and the middle picture illustrate the same scenarios as Figure [5] for aa^ = 0. In addition, 
an intermediate initial state is displayed (x = 0.6). The right picture illustrates the fact that •) is not 
differentiable at x = ^ . The parameters are the same as in Figure [5] 



We illustrate the structure of the optimal control in the left and the middle picture of Figure [31 All lines 
have the same meaning as in Figure [5J we only add a realized trajectory for an intermediate initial state which 
is only slightly larger than the boundary /3(0) = ^T". We observe that the optimal trajectory X*{s) never 
crosses the boundary s) if t'' does not jump. Let us brie fly comment on this structure. For aa^ = = 0, 

the optimal absolutely continuous control is constant (see, e.g., Kratz and Schoneborn |2012b |: cf. also the thin 
solid line in the middle picture of Figure [3] which refers to acr^ =0 = 0). The boundary itself is linear and 
it is the trajectory of the optimal control (for = 0) with initial state on the boundary. If the initial state is 
above the boundary, > decreases the optimal absolutely continuous control, i.e., if tt does not jump, the 
trajectory is concave and thus never crosses the boundary. If tt jumps (in the displayed scenario at time r), 
the resulting state is again on the boundary. However, it does not cross it but stays on it until the end of the 
horizon. Finally, the boundary /3 is decreasing in acr^ (cf., e.g.. Equation p^ l. This results in the small state 
in the left picture to be below the boundary from the beginning (cf. Figure [21 where the same initial state was 
above the respective boundary). Again, the optimal absolutely continuous control is constant in this case. 

By analyzing Equation (|57p . we can observe that £,*{t, •) is continuous but not differentiable at = /3{t) = 



2A 



{T — t). The right picture of Figure [3] illustrates this property. 



6.3 Optimal liquidation in dark pools with adverse selection 



The Optimization problem (jOPTp is motivated by a cost minimizing problem in finance. In the following, we 
describe this application. 

In recent years, equity trading has been transformed by the advent of so-called dark pools. These alterna- 
tive trading venues differ significantly from classical exchanges and have gained a considerable market share, 
especially in the US. They generally share the following two stylized facts. First, the liquidity available in dark 
pools is not quoted, hence making trade execution uncertain and unpredictable. Second, dark pools do not 
determine prices. Instead, they monitor the pri ces determin ed b y the classical excha nges and settle trades in 
the dark pool only if possible at these prices (see Mittall |2008| and Degrvse et al. [2 



)3 for further details and a 

typology of dark pools). In traditional exchanges, large transactions can result in adverse price movements due 
to a lack of liquidity in the market or because of the information revealed by them. Trades in the dark pool have 
no or less price impact. On the other hand, order execution in dark pools is uncertain and cannot be enforced. 
Additionally, dark pool orders incorporate indirect costs by so-called adverse selection: Liquidity seeking traders 
find that their trades in the dark pool are usually executed just before a favorable price move in the mark et, i.e., 
exactly when they do not want them to be e xecuted since they miss out on the price improvement (see iMittal 
2008j for explanations for adverse selection; iHendershott and Mendelson |2000j find theoretical evidence that 



adverse selection arises due to information asymmetries in the market). 

In the following, we consider a risk averse investor who has to liquidate a position x e R in a risky asset within 
a finite time horizon [0, T]. The investor has the o pportunity to trade at a trad itional exchange by controlling her 
trading intensity ^; due to linear price impact (see Almgren and Chriss |2001 |) this yields quadratic price impact 
costs A£^{s)ds. Additionally she can place orders 77 in a dark pool; we model order execution by the Poisson 
process tt: the orders are executed fully at the jump times of tt. While no price impact costs have to be paid 
for dark pool orders, indirect costs 9T\r]{s)\ds arise from adverse selection. Kratz and Schoneborn |2012a) 
justify this cost term for adverse sele ction for the discrete t ime a nalogue of the market model; for the continuous 
time model this is accomplished by iNauiokat and Horst We can interpret the controlled process X" 

{u = (^, r/)) as the stock holdings of the investor; the liquidation constraint is reflected by Definition 12.11 fiv). 
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The last term in the additive penahy function, a a'^X^{s)'^ds, reflects the market risk of the position and 
penahzes slow liquidation; here, a > is the personal risk aversion of the inv estor and is the variance of the 



price process of the asset (this expression for the market risk is again due to lAlmgren and ChrissI [2001|). The 
case acr^ = treated in Section [6T2] hence describes the important special case of a risk neutral investor. 

The Optimization Problem (|OPT[) hence reflects the trade-off of price impact costs versus execution uncer- 
tainty and adverse selection costs faced by the investor. As discussed in Sections 16.11 and 16.21 adverse selection 
changes the optimal strategy in two main respects: Instead of placing the full remainder of the position in th e 



dark pool (as it is the case for optimal liquidation without adverse selection, see lKratz and Schoneborn |2012bj : 



cf. also the right picture of Figure [2|) a smaller fraction is offered in the dark pool as the investor does not want 
to miss out on the expected favorable impending price move completely; for small positions, the dark pool is 
not used at all. On the other hand, the trading intensity in the traditional exchange is increased. 
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